Intercoder Reliability Dashboard
2025-09-24
Problematic Codes
Codes Needing Immediate Attention (Lowest Reliability)
Focus on these codes during training - they show the most disagreement between coders:
1. AI Image/Video_Partly AI_bin
***
Agreement: 40.0% | Krippendorff α: 0.359 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 6 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 1 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 2 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 4 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
- Content 5 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
Agreement: 40.0% | Krippendorff α: 0.359 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 6 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 1 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 2 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 4 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
- Content 5 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
2. AI Image/Video_Completely AI_bin
***
Agreement: 40.0% | Krippendorff α: 0.375 | 2-way splits: 2 | Units: 40
Example disagreements:
- Content 6 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 11 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 2 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
Agreement: 40.0% | Krippendorff α: 0.375 | 2-way splits: 2 | Units: 40
Example disagreements:
- Content 6 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 11 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 2 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
3. Type of Attack__Attack on political
issues/achievements/ideologies_bin
***
Agreement: 47.5% | Krippendorff α: 0.402 | 2-way splits: 3 | Units: 40
Example disagreements:
- Content 31 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 33 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 37 (2 disagreements): X/Twitter Post | DA:✓ DO:✗ E:✓ L:✗
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
Agreement: 47.5% | Krippendorff α: 0.402 | 2-way splits: 3 | Units: 40
Example disagreements:
- Content 31 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 33 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 37 (2 disagreements): X/Twitter Post | DA:✓ DO:✗ E:✓ L:✗
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
4. Theme of the Image/Video__Political positioning_bin
***
Agreement: 47.5% | Krippendorff α: 0.409 | 2-way splits: 7 | Units: 40
Example disagreements:
- Content 3 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 4 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✓
- Content 7 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 13 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 16 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
Agreement: 47.5% | Krippendorff α: 0.409 | 2-way splits: 7 | Units: 40
Example disagreements:
- Content 3 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 4 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✓
- Content 7 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 13 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 16 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
5. Type of Acclaim__Acclaim/Praise/Recognition of political
issues/achievements/ideologies_bin
***
Agreement: 52.5% | Krippendorff α: 0.291 | 2-way splits: 2 | Units: 40
Example disagreements:
- Content 2 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 27 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 16 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✓
Agreement: 52.5% | Krippendorff α: 0.291 | 2-way splits: 2 | Units: 40
Example disagreements:
- Content 2 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 27 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 16 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✓
6. Theme of the Image/Video__Negative imagery/Negative
campaigning: The image/video portrays the political opponent in a
negative light. This can happen through sharp criticism or with
humor._bin
**
Agreement: 52.5% | Krippendorff α: 0.451 | 2-way splits: 5 | Units: 40
Example disagreements:
- Content 4 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 7 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 32 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 35 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 38 (2 disagreements): X/Twitter Post | DA:✓ DO:✓ E:✗ L:✗
Agreement: 52.5% | Krippendorff α: 0.451 | 2-way splits: 5 | Units: 40
Example disagreements:
- Content 4 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 7 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 32 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 35 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 38 (2 disagreements): X/Twitter Post | DA:✓ DO:✓ E:✗ L:✗
7.
Topics__political_parties_and_politicians_candidate_presentation_politicians_as_the_main_subject_bin
**
Agreement: 52.5% | Krippendorff α: 0.473 | 2-way splits: 2 | Units: 40
Example disagreements:
- Content 14 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✓
- Content 34 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
Agreement: 52.5% | Krippendorff α: 0.473 | 2-way splits: 2 | Units: 40
Example disagreements:
- Content 14 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✓
- Content 34 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
8. Type of Attack__Attack on a
person/party/organization/institution_bin
**
Agreement: 55.0% | Krippendorff α: 0.534 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 16 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
- Content 17 (1 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✓
- Content 2 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
Agreement: 55.0% | Krippendorff α: 0.534 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 16 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
- Content 17 (1 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✓
- Content 2 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
9. Type of Acclaim__Acclaim/Praise/Recognition of a
person/party/organization/institution_bin
**
Agreement: 57.5% | Krippendorff α: 0.525 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 5 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 6 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
- Content 39 (1 disagreements): Facebook Post | DO:✓ E:✓ L:✓
Agreement: 57.5% | Krippendorff α: 0.525 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 5 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 6 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
- Content 39 (1 disagreements): Facebook Post | DO:✓ E:✓ L:✓
10. Target of Attack__(Members of) minorities_bin
**
Agreement: 57.5% | Krippendorff α: 0.423 | 2-way splits: 2 | Units: 40
Example disagreements:
- Content 8 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 23 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 1 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✓
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✓
Agreement: 57.5% | Krippendorff α: 0.423 | 2-way splits: 2 | Units: 40
Example disagreements:
- Content 8 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 23 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 1 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✓
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✓
11. Actors__(Members of) minorities_bin
**
Agreement: 57.5% | Krippendorff α: 0.485 | 2-way splits: 7 | Units: 40
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 6 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 13 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✓
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
- Content 28 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
Agreement: 57.5% | Krippendorff α: 0.485 | 2-way splits: 7 | Units: 40
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 6 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 13 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✓
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
- Content 28 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
12. Theme of the Image/Video__Events/Landscape & city
scenes: Unlike a symbolic image, people/politicians are doing something,
moving, or working (e.g., groups such as politicians, refugees, farmers,
protesters, police officers, etc.). Alternatively, a city or (natural)
landscape is shown where something is happening (e.g., forest dieback,
fire, or flooding, nuclear power plants or wind turbines)._bin
***
Agreement: 60.0% | Krippendorff α: 0.164 | 2-way splits: 4 | Units: 40
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 2 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 22 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 31 (2 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
Agreement: 60.0% | Krippendorff α: 0.164 | 2-way splits: 4 | Units: 40
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 2 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 22 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 31 (2 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
13. Theme of the Image/Video__Symbolic image of
person(s)/politician(s)/citizen(s) looking directly into the camera
(classic campaign poster image)._bin
**
Agreement: 60.0% | Krippendorff α: 0.485 | 2-way splits: 3 | Units: 40
Example disagreements:
- Content 19 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 23 (2 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✗
- Content 31 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 13 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✓
Agreement: 60.0% | Krippendorff α: 0.485 | 2-way splits: 3 | Units: 40
Example disagreements:
- Content 19 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 23 (2 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✗
- Content 31 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 13 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✓
14. Actors__Ordinary people / average citizens / ordinary
supporters_bin
**
Agreement: 60.0% | Krippendorff α: 0.551 | 2-way splits: 4 | Units: 40
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 6 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 8 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 27 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
Agreement: 60.0% | Krippendorff α: 0.551 | 2-way splits: 4 | Units: 40
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 6 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 8 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 27 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
15. People in the
Image/Video__Ordinary_people___average_citizens___ordinary_supporterse_g_individuals_as_well_as_groups_of_citizens_such_as_teachers__pensioners__students__caregivers__etc___bin
**
Agreement: 62.5% | Krippendorff α: 0.595 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 22 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
- Content 10 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
Agreement: 62.5% | Krippendorff α: 0.595 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 22 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
- Content 10 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
16. Target of Acclaim__PVV_bin
*
Agreement: 65.0% | Krippendorff α: 0.621 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 5 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 6 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
- Content 39 (1 disagreements): Facebook Post | DO:✓ E:✓ L:✓
- Content 10 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
Agreement: 65.0% | Krippendorff α: 0.621 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 5 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 6 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
- Content 39 (1 disagreements): Facebook Post | DO:✓ E:✓ L:✓
- Content 10 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
17. Theme of the Image/Video__Positive imagery/Acclaims: The
image/video portrays past and future achievements of the
party/government in a positive light. This includes drawing a positive
balance, saying “thank you” to campaign helpers, or positively
discussing political plans/goals._bin
***
Agreement: 65.0% | Krippendorff α: 0.088 | 2-way splits: 5 | Units: 40
Example disagreements:
- Content 2 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 3 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 5 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 16 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 19 (2 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✗
Agreement: 65.0% | Krippendorff α: 0.088 | 2-way splits: 5 | Units: 40
Example disagreements:
- Content 2 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 3 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 5 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 16 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 19 (2 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✗
18. AI Labeling in Post/Ad_bin
**
Agreement: 65.0% | Krippendorff α: 0.487 | 2-way splits: 4 | Units: 40
Example disagreements:
- Content 2 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 9 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 10 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 13 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 4 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
Agreement: 65.0% | Krippendorff α: 0.487 | 2-way splits: 4 | Units: 40
Example disagreements:
- Content 2 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 9 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 10 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 13 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 4 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
19. Target of Acclaim__PVV: Geert Wilders_bin
**
Agreement: 65.0% | Krippendorff α: 0.487 | 2-way splits: 2 | Units: 40
Example disagreements:
- Content 9 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 27 (2 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✗
- Content 16 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
- Content 24 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
- Content 28 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
Agreement: 65.0% | Krippendorff α: 0.487 | 2-way splits: 2 | Units: 40
Example disagreements:
- Content 9 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 27 (2 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✗
- Content 16 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
- Content 24 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
- Content 28 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
20. Theme of the Image/Video__Event announcement/Election
call/Candidate presentation_bin
***
Agreement: 67.5% | Krippendorff α: 0.363 | 2-way splits: 4 | Units: 40
Example disagreements:
- Content 6 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 8 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 10 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 16 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
Agreement: 67.5% | Krippendorff α: 0.363 | 2-way splits: 4 | Units: 40
Example disagreements:
- Content 6 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 8 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 10 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 16 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
21. Number of People in the Image/Video_bin
**
Agreement: 67.5% | Krippendorff α: 0.570 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 8 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 23 (1 disagreements): Instagram Post | DA:✓ DO:✓ E:✓ L:✗
Agreement: 67.5% | Krippendorff α: 0.570 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 8 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 23 (1 disagreements): Instagram Post | DA:✓ DO:✓ E:✓ L:✗
22.
Topics__civil_rights_including_gender_politics_lgbtq_policies_bin
***
Agreement: 70.0% | Krippendorff α: 0.146 | 2-way splits: 2 | Units: 40
Example disagreements:
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
- Content 32 (2 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 10 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
Agreement: 70.0% | Krippendorff α: 0.146 | 2-way splits: 2 | Units: 40
Example disagreements:
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
- Content 32 (2 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 10 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
23. People in the
Image/Video___Members_of__minoritiese_g_refugeesLGBTQ_people_with_disabilities__Jewish_people__women__when_women_are_explicitly_labeled__depicted__or_referred_to_as_a_minority__bin
**
Agreement: 70.0% | Krippendorff α: 0.553 | 2-way splits: 4 | Units: 40
Example disagreements:
- Content 22 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
- Content 27 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 33 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
Agreement: 70.0% | Krippendorff α: 0.553 | 2-way splits: 4 | Units: 40
Example disagreements:
- Content 22 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
- Content 27 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 33 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✓
- Content 7 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
24. Target of Acclaim__Ordinary people / average citizens /
ordinary supporters_bin
***
Agreement: 75.0% | Krippendorff α: 0.081 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 2 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 28 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
- Content 39 (2 disagreements): Facebook Post | DO:✓ E:✗ L:✓
- Content 13 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✗
Agreement: 75.0% | Krippendorff α: 0.081 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 2 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 28 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
- Content 39 (2 disagreements): Facebook Post | DO:✓ E:✗ L:✓
- Content 13 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✗
25.
Topics__election_in_general_electoral_system_campaign_events_campaign_dates_campaign_appearances_election_polls_bin
***
Agreement: 80.0% | Krippendorff α: 0.188 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 14 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 2 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 7 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 13 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
Agreement: 80.0% | Krippendorff α: 0.188 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 14 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 2 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 3 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 7 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 13 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
26. Actors__Dutch government, ministries, parliament, and courts
(ALSO KABINET SCHOOF)_bin
***
Agreement: 82.5% | Krippendorff α: 0.037 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 35 (2 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 23 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
- Content 24 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
- Content 28 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
Agreement: 82.5% | Krippendorff α: 0.037 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 35 (2 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 23 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
- Content 24 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
- Content 28 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
27. Topics__environmental_and_energy_policy_bin
**
Agreement: 85.0% | Krippendorff α: 0.542 | 2-way splits: 3 | Units: 40
Example disagreements:
- Content 18 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 19 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 31 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 33 (1 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✓
Agreement: 85.0% | Krippendorff α: 0.542 | 2-way splits: 3 | Units: 40
Example disagreements:
- Content 18 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 19 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 31 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 33 (1 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✓
28. Target of Attack__Dutch government, ministries, parliament,
and courts (ALSO KABINET SCHOOF)_bin
***
Agreement: 87.5% | Krippendorff α: -0.030 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 6 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 18 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
Agreement: 87.5% | Krippendorff α: -0.030 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 6 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 18 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
29. Topics__europe_bin
***
Agreement: 87.5% | Krippendorff α: 0.256 | 2-way splits: 4 | Units: 40
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 8 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 19 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 37 (2 disagreements): X/Twitter Post | DA:✗ DO:✓ E:✓ L:✗
- Content 33 (1 disagreements): TikTok Video | DA:✗ DO:✗ E:✓ L:✗
Agreement: 87.5% | Krippendorff α: 0.256 | 2-way splits: 4 | Units: 40
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 8 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 19 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
- Content 37 (2 disagreements): X/Twitter Post | DA:✗ DO:✓ E:✓ L:✗
- Content 33 (1 disagreements): TikTok Video | DA:✗ DO:✗ E:✓ L:✗
30. Theme of the Image/Video__Fantasy / futuristic scenarios or
depictions of imagined or speculative realities (utopian or dystopian
future Netherlands)_bin
**
Agreement: 87.5% | Krippendorff α: 0.513 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 3 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 17 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
- Content 23 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
- Content 38 (1 disagreements): X/Twitter Post | DA:✗ DO:✗ E:✓ L:✗
Agreement: 87.5% | Krippendorff α: 0.513 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 3 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 9 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 17 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
- Content 23 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
- Content 38 (1 disagreements): X/Twitter Post | DA:✗ DO:✗ E:✓ L:✗
31. Topics__housing_crisis_bin
**
Agreement: 87.5% | Krippendorff α: 0.521 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 6 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 1 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 8 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 12 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
Agreement: 87.5% | Krippendorff α: 0.521 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 6 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 1 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 8 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 12 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
32. Topics__economy_and_finance_bin
**
Agreement: 87.5% | Krippendorff α: 0.584 | 2-way splits: 2 | Units: 40
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 8 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 37 (1 disagreements): X/Twitter Post | DA:✗ DO:✓ E:✓ L:✓
- Content 39 (2 disagreements): Facebook Post | DO:✗ E:✓ L:✓
Agreement: 87.5% | Krippendorff α: 0.584 | 2-way splits: 2 | Units: 40
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 8 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✗
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 37 (1 disagreements): X/Twitter Post | DA:✗ DO:✓ E:✓ L:✓
- Content 39 (2 disagreements): Facebook Post | DO:✗ E:✓ L:✓
33. Topics__foreign_security_and_defense_policy_bin
***
Agreement: 90.0% | Krippendorff α: 0.194 | 2-way splits: 2 | Units: 40
Example disagreements:
- Content 26 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✓
- Content 35 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✓
- Content 19 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
- Content 30 (1 disagreements): TikTok Video | DA:✗ DO:✓ L:✗
Agreement: 90.0% | Krippendorff α: 0.194 | 2-way splits: 2 | Units: 40
Example disagreements:
- Content 26 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✓
- Content 35 (2 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✓
- Content 19 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
- Content 30 (1 disagreements): TikTok Video | DA:✗ DO:✓ L:✗
34. Actors__Europe/EU/NATO, EU/NATO institutions and bodies
& their representatives_bin
***
Agreement: 90.0% | Krippendorff α: 0.354 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 37 (2 disagreements): X/Twitter Post | DA:✗ DO:✗ E:✓ L:✓
- Content 1 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
- Content 8 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
- Content 19 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✓ L:✗
Agreement: 90.0% | Krippendorff α: 0.354 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 37 (2 disagreements): X/Twitter Post | DA:✗ DO:✗ E:✓ L:✓
- Content 1 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
- Content 8 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
- Content 19 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✓ L:✗
35. People in the
Image/Video__Illegal_actors__criminals__offenders__terrorists__extremists___extremist_groups__Actors_who_commit_generally_criminally_relevant_actions_without_being_associated_with_a_specific_party__business___non_terrorist__organization__or__non_extremist__social_movementplease_code_them_accordingly_actors_who_plan_and_carry_out_criminal_activities_in_a_structured_group__actors_who_use_violence_bin
***
Agreement: 92.5% | Krippendorff α: -0.017 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 10 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 24 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
- Content 40 (1 disagreements): Instagram Post | DO:✓ E:✗ L:✗
Agreement: 92.5% | Krippendorff α: -0.017 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 10 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 24 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
- Content 40 (1 disagreements): Instagram Post | DO:✓ E:✗ L:✗
36. Theme of the Image/Video__Image from a campaign
event_bin
***
Agreement: 92.5% | Krippendorff α: -0.017 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 2 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 13 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 26 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
Agreement: 92.5% | Krippendorff α: -0.017 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 2 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 13 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 26 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
37. Theme of the Image/Video__Everyday politics_bin
***
Agreement: 92.5% | Krippendorff α: -0.017 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 9 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 14 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 35 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✗
Agreement: 92.5% | Krippendorff α: -0.017 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 9 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✗
- Content 14 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 35 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✗
38. Actors__News media and their journalists /
representatives_bin
***
Agreement: 92.5% | Krippendorff α: -0.017 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 5 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
- Content 16 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✓ L:✗
- Content 32 (1 disagreements): TikTok Video | DA:✗ DO:✗ E:✗ L:✓
Agreement: 92.5% | Krippendorff α: -0.017 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 5 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
- Content 16 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✓ L:✗
- Content 32 (1 disagreements): TikTok Video | DA:✗ DO:✗ E:✗ L:✓
39. Actors__(Representatives of) non-political
institutions_bin
***
Agreement: 92.5% | Krippendorff α: 0.147 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 35 (2 disagreements): TikTok Video | DA:✗ DO:✗ E:✓ L:✓
- Content 31 (1 disagreements): TikTok Video | DA:✗ DO:✗ E:✗ L:✓
- Content 37 (1 disagreements): X/Twitter Post | DA:✗ DO:✗ E:✓ L:✗
Agreement: 92.5% | Krippendorff α: 0.147 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 35 (2 disagreements): TikTok Video | DA:✗ DO:✗ E:✓ L:✓
- Content 31 (1 disagreements): TikTok Video | DA:✗ DO:✗ E:✗ L:✓
- Content 37 (1 disagreements): X/Twitter Post | DA:✗ DO:✗ E:✓ L:✗
40. Target of Attack__Illegal actors, criminals, offenders,
terrorists, extremists / extremist groups_bin
***
Agreement: 92.5% | Krippendorff α: 0.147 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 16 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
Agreement: 92.5% | Krippendorff α: 0.147 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 4 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 16 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
41. Actors__Illegal actors, criminals, offenders, terrorists,
extremists / extremist groups_bin
***
Agreement: 92.5% | Krippendorff α: 0.382 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 24 (1 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✓
- Content 28 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
- Content 40 (1 disagreements): Instagram Post | DO:✓ E:✗ L:✗
Agreement: 92.5% | Krippendorff α: 0.382 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 24 (1 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✓
- Content 28 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
- Content 40 (1 disagreements): Instagram Post | DO:✓ E:✗ L:✗
42. Target of Attack__Europe/EU/NATO, EU/NATO institutions and
bodies & their representatives_bin
***
Agreement: 95.0% | Krippendorff α: -0.011 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 1 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 8 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
Agreement: 95.0% | Krippendorff α: -0.011 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 1 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 8 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
43. People in the
Image/Video__Representatives_of_social_movementse_g_Fridays_for_Future__Identitarian_Movement__QAnon___MeToo_movement__bin
***
Agreement: 95.0% | Krippendorff α: 0.209 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
- Content 28 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✓ L:✗
Agreement: 95.0% | Krippendorff α: 0.209 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✗
- Content 28 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✓ L:✗
44. Actors__(Representatives of) social movements_bin
**
Agreement: 95.0% | Krippendorff α: 0.488 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 26 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✓
- Content 28 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✓ L:✗
Agreement: 95.0% | Krippendorff α: 0.488 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 26 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✓ L:✓
- Content 28 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✓ L:✗
45. Target of Attack__PVV_bin
*
Agreement: 95.0% | Krippendorff α: 0.654 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 34 (1 disagreements): TikTok Video | DA:✓ DO:✓ E:✓ L:✗
- Content 35 (1 disagreements): TikTok Video | DA:✓ DO:✓ E:✓ L:✗
Agreement: 95.0% | Krippendorff α: 0.654 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 34 (1 disagreements): TikTok Video | DA:✓ DO:✓ E:✓ L:✗
- Content 35 (1 disagreements): TikTok Video | DA:✓ DO:✓ E:✓ L:✗
46. Target of Attack__PVV: Geert Wilders_bin
*
Agreement: 95.0% | Krippendorff α: 0.654 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 34 (1 disagreements): TikTok Video | DA:✓ DO:✓ E:✓ L:✗
- Content 35 (1 disagreements): TikTok Video | DA:✓ DO:✓ E:✓ L:✗
Agreement: 95.0% | Krippendorff α: 0.654 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 34 (1 disagreements): TikTok Video | DA:✓ DO:✓ E:✓ L:✗
- Content 35 (1 disagreements): TikTok Video | DA:✓ DO:✓ E:✓ L:✗
47. People in the
Image/Video__GL_PvdA__Esmah_Lahlah_bin
***
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 33 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✗
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 33 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✗
48. People in the
Image/Video__GL_PvdA__Jesse_Klaver_bin
***
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 33 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✗
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 33 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✗
49. People in the
Image/Video__GL_PvdA__Marjolein_Moorman_bin
***
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 33 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✗
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 33 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✗
50. People in the Image/Video__GL_PvdA__Mei_Li_Vos_bin
***
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 33 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✗
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 33 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✗
51. People in the
Image/Video__Journalists__representatives_of_news_media__general__media_types__individual_media_outlets__bin
***
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 16 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✓ L:✗
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 16 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✓ L:✗
52. Names of Actors__Pim_Fortuyn_bin
***
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 2 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 2 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
53. Names of Actors__Douwe_bob_bin
***
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 19 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 19 (1 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✗
54. Names of Actors__Security_guard_Geert_Wilders_bin
***
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 2 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 2 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
55. Names of Actors__Depicted_as_politicians_bin
***
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 35 (1 disagreements): TikTok Video | DA:✗ DO:✗ E:✓ L:✗
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 35 (1 disagreements): TikTok Video | DA:✗ DO:✗ E:✓ L:✗
56. Names of Actors__not_real_people_bin
***
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 35 (1 disagreements): TikTok Video | DA:✗ DO:✗ E:✓ L:✗
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 35 (1 disagreements): TikTok Video | DA:✗ DO:✗ E:✓ L:✗
57. Theme of the Image/Video__Media work (incl. TV
debate)_bin
***
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 35 (1 disagreements): TikTok Video | DA:✓ DO:✗ E:✗ L:✗
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 35 (1 disagreements): TikTok Video | DA:✓ DO:✗ E:✗ L:✗
58. Actors__GL-PvdA: Esmah Lahlah_bin
***
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 33 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✗
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 33 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✗
59. Actors__GL-PvdA: Jesse Klaver_bin
***
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 33 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✗
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 33 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✗
60. Actors__GL-PvdA: Marjolein Moorman_bin
***
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 33 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✗
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 33 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✗
61. Actors__GL-PvdA: Mei Li Vos_bin
***
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 33 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✗
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 33 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✗ L:✗
62. Target of Attack__Ordinary people / average citizens /
ordinary supporters_bin
***
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 40 (1 disagreements): Instagram Post | DO:✗ E:✗ L:✓
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 40 (1 disagreements): Instagram Post | DO:✗ E:✗ L:✓
63. Target of Attack__Foreign politicians or parties and/or
foreign governments, foreign parliaments_bin
***
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
64. AI Labeling in Image/Video_bin
***
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 32 (1 disagreements): TikTok Video | DA:✗ DO:✗ E:✓ L:✗
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 32 (1 disagreements): TikTok Video | DA:✗ DO:✗ E:✓ L:✗
65. Topics__education_and_culture_bin
***
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 10 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
Agreement: 97.5% | Krippendorff α: -0.004 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 10 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✓
66. People in the
Image/Video__Foreign_politicians__ALL_EXCEPT_from_EU__UN__NATO__bin
***
Agreement: 97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 33 (2 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✗
Agreement: 97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 33 (2 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✗
67. People in the
Image/Video__Foreign_politicians_from_EU__UN__NATO_bin
***
Agreement: 97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 33 (2 disagreements): TikTok Video | DA:✗ DO:✗ E:✓ L:✓
Agreement: 97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 33 (2 disagreements): TikTok Video | DA:✗ DO:✗ E:✓ L:✓
68. People in the
Image/Video__Celebrities_and_or_opinion_leaderse_g_actors__sports_figures_athletes__musicians__economists__social_media_influencers__bin
***
Agreement: 97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 19 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
Agreement: 97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 19 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
69. Names of Actors__Douwe_Bob_bin
***
Agreement: 97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 19 (2 disagreements): Instagram Post | DA:✗ DO:✗ E:✓ L:✓
Agreement: 97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 19 (2 disagreements): Instagram Post | DA:✗ DO:✗ E:✓ L:✓
70. Theme of the Image/Video__Individual voter
contact_bin
***
Agreement: 97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 16 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
Agreement: 97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 16 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
71. Actors__(Representatives of) interest groups,
NGOs_bin
***
Agreement: 97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 37 (2 disagreements): X/Twitter Post | DA:✗ DO:✗ E:✓ L:✓
Agreement: 97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 37 (2 disagreements): X/Twitter Post | DA:✗ DO:✗ E:✓ L:✓
72. Target of Attack__Celebrities and/or opinion
leaders_bin
***
Agreement: 97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 19 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
Agreement: 97.5% | Krippendorff α: 0.326 | 2-way splits: 1 | Units: 40
Example disagreements:
- Content 19 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✗
73. Target of Acclaim__VVD_bin
***
Agreement: 97.5% | Krippendorff α: 0.326 | 2-way splits: 0 | Units: 40
Agreement: 97.5% | Krippendorff α: 0.326 | 2-way splits: 0 | Units: 40
74. Target of Acclaim__(Representatives of) social
movements_bin
***
Agreement: 97.5% | Krippendorff α: 0.326 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
Agreement: 97.5% | Krippendorff α: 0.326 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 26 (2 disagreements): Instagram Post | DA:✓ DO:✗ E:✗ L:✓
75. Topics__labor_and_social_issues_bin
***
Agreement: 97.5% | Krippendorff α: 0.326 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 39 (2 disagreements): Facebook Post | DO:✓ E:✓ L:✗
Agreement: 97.5% | Krippendorff α: 0.326 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 39 (2 disagreements): Facebook Post | DO:✓ E:✓ L:✗
76. Names of Actors__Donald_Trump_bin
*
Agreement: 97.5% | Krippendorff α: 0.661 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 33 (1 disagreements): TikTok Video | DA:✓ DO:✗ E:✓ L:✓
Agreement: 97.5% | Krippendorff α: 0.661 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 33 (1 disagreements): TikTok Video | DA:✓ DO:✗ E:✓ L:✓
77. Names of Actors__Bob_bin
*
Agreement: 97.5% | Krippendorff α: 0.661 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 19 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✓
Agreement: 97.5% | Krippendorff α: 0.661 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 19 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✓
78. Actors__Celebrities and/or opinion leaders_bin
*
Agreement: 97.5% | Krippendorff α: 0.661 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 19 (1 disagreements): Instagram Post | DA:✓ DO:✓ E:✓ L:✗
Agreement: 97.5% | Krippendorff α: 0.661 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 19 (1 disagreements): Instagram Post | DA:✓ DO:✓ E:✓ L:✗
79. Target of Attack__D66_bin
*
Agreement: 97.5% | Krippendorff α: 0.661 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 32 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✓
Agreement: 97.5% | Krippendorff α: 0.661 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 32 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✓
80. Target of Attack__D66: Rob Jetten_bin
*
Agreement: 97.5% | Krippendorff α: 0.661 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 32 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✓
Agreement: 97.5% | Krippendorff α: 0.661 | 2-way splits: 0 | Units: 40
Example disagreements:
- Content 32 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✓
Acceptable and Good Codes (≥ 0.667 Krippendorff’s Alpha)
These codes show good to excellent reliability between coders:
People in the Image/Video__PVV__Geert_Wilders_bin
Agreement: 100.0% | Krippendorff α: 1.000 | Interpretation: Excellent | Units: 40 | Usage: 15.0% (24/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 5 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
Actors__CDA_bin
Agreement: 100.0% | Krippendorff α: 1.000 | Interpretation: Excellent | Units: 40 | Usage: 10.0% (16/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 3 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 5 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Actors__CDA: Henri Bontenbal_bin
Agreement: 100.0% | Krippendorff α: 1.000 | Interpretation: Excellent | Units: 40 | Usage: 7.5% (12/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 3 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 5 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Target of Attack__CDA_bin
Agreement: 100.0% | Krippendorff α: 1.000 | Interpretation: Excellent | Units: 40 | Usage: 10.0% (16/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 7 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 8 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 9 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Target of Attack__CDA: Henri Bontenbal_bin
Agreement: 100.0% | Krippendorff α: 1.000 | Interpretation: Excellent | Units: 40 | Usage: 7.5% (12/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 7 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 8 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 9 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Actors__GL-PvdA_bin
Agreement: 97.5% | Krippendorff α: 0.970 | Interpretation: Excellent | Units: 40 | Usage: 29.4% (47/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 5 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Actors__GL-PvdA: Frans Timmermans_bin
Agreement: 97.5% | Krippendorff α: 0.968 | Interpretation: Excellent | Units: 40 | Usage: 26.9% (43/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 5 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Target of Attack__GL-PvdA_bin
Agreement: 92.5% | Krippendorff α: 0.896 | Interpretation: Excellent | Units: 40 | Usage: 27.5% (44/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 7 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 8 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 9 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Target of Attack__GL-PvdA: Frans Timmermans_bin
Agreement: 92.5% | Krippendorff α: 0.889 | Interpretation: Excellent | Units: 40 | Usage: 25.0% (40/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 7 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 8 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 9 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
AI Image/Video_Not AI_bin
Agreement: 95.0% | Krippendorff α: 0.882 | Interpretation: Excellent | Units: 40 | Usage: 14.4% (23/160)
Example disagreements:
- Content 11 (2 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✓
- Content 18 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
- Content 1 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 2 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 3 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Actors__PVV: Geert Wilders_bin
Agreement: 87.5% | Krippendorff α: 0.867 | Interpretation: Excellent | Units: 40 | Usage: 48.8% (78/160)
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✓
- Content 12 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 24 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
Actors__PVV_bin
Agreement: 87.5% | Krippendorff α: 0.860 | Interpretation: Excellent | Units: 40 | Usage: 61.3% (98/160)
Example disagreements:
- Content 6 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 36 (1 disagreements): TikTok Video | DA:✗ DO:✓ E:✓ L:✓
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
People in the Image/Video__GL_PvdA__Frans_Timmermans_bin
Agreement: 87.5% | Krippendorff α: 0.800 | Interpretation: Excellent | Units: 40 | Usage: 19.4% (31/160)
Example disagreements:
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 8 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 37 (1 disagreements): X/Twitter Post | DA:✓ DO:✓ E:✓ L:✗
- Content 2 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
People in the Image/Video__CDA__Henri_Bontenbal_bin
Agreement: 95.0% | Krippendorff α: 0.787 | Interpretation: Good | Units: 40 | Usage: 6.2% (10/160)
Example disagreements:
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 8 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 2 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 3 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 4 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Topics__call_to_vote_get_out_the_vote_call_without_and_with_naming_of_party_s_bin
Agreement: 80.0% | Krippendorff α: 0.765 | Interpretation: Good | Units: 40 | Usage: 39.4% (63/160)
Example disagreements:
- Content 13 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✗ L:✓
- Content 10 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✓
- Content 14 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✗ L:✗
- Content 16 (1 disagreements): Instagram Post | DA:✓ DO:✓ E:✗ L:✓
AI Image/Video (AI or not)_bin
Agreement: 87.5% | Krippendorff α: 0.756 | Interpretation: Good | Units: 40 | Usage: 83.8% (134/160)
Example disagreements:
- Content 11 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 18 (1 disagreements): Instagram Post | DA:✓ DO:✓ E:✓ L:✗
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
Negative Tendency/Tonality_bin
Agreement: 87.5% | Krippendorff α: 0.756 | Interpretation: Good | Units: 40 | Usage: 83.8% (134/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 5 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
Positive Tendency/Tonality_bin
Agreement: 87.5% | Krippendorff α: 0.756 | Interpretation: Good | Units: 40 | Usage: 83.8% (134/160)
Example disagreements:
- Content 1 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 2 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 3 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 4 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
- Content 5 (0 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✓
Theme of the Image/Video__Humor / Satire (depictions used to mock, exaggerate, or parody)_bin
Agreement: 80.0% | Krippendorff α: 0.743 | Interpretation: Good | Units: 40 | Usage: 30.0% (48/160)
Example disagreements:
- Content 1 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 37 (2 disagreements): X/Twitter Post | DA:✗ DO:✗ E:✓ L:✓
- Content 8 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 12 (1 disagreements): Facebook Post | DA:✓ DO:✓ E:✓ L:✗
- Content 17 (1 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✗
Actors__VVD_bin
Agreement: 92.5% | Krippendorff α: 0.694 | Interpretation: Good | Units: 40 | Usage: 8.1% (13/160)
Example disagreements:
- Content 24 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✓
- Content 28 (2 disagreements): Instagram Post | DA:✗ DO:✓ E:✗ L:✓
- Content 23 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✗ L:✓
- Content 1 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
- Content 2 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Topics__domestic_and_migration_policy_public_safety_crime_incl_femicide_political_radicalism_religious_fanaticism_terrorism_bin
Agreement: 72.5% | Krippendorff α: 0.692 | Interpretation: Good | Units: 40 | Usage: 51.9% (83/160)
Example disagreements:
- Content 10 (2 disagreements): Facebook Post | DA:✓ DO:✓ E:✗ L:✗
- Content 11 (2 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✗
- Content 35 (2 disagreements): TikTok Video | DA:✓ DO:✓ E:✗ L:✗
- Content 1 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
- Content 8 (1 disagreements): Facebook Post | DA:✓ DO:✗ E:✓ L:✓
Theme of the Image/Video__Nostalgic / historical Dutch imagery (references to glorified past or national symbols)_bin
Agreement: 90.0% | Krippendorff α: 0.688 | Interpretation: Good | Units: 40 | Usage: 8.8% (14/160)
Example disagreements:
- Content 10 (1 disagreements): Facebook Post | DA:✗ DO:✓ E:✓ L:✓
- Content 13 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 14 (1 disagreements): Facebook Post | DA:✗ DO:✗ E:✓ L:✗
- Content 28 (1 disagreements): Instagram Post | DA:✗ DO:✗ E:✓ L:✗
- Content 1 (0 disagreements): Facebook Post | DA:✗ DO:✗ E:✗ L:✗
Most Problematic Content Pieces (Highest Overall Disagreement)
These content pieces have the most disagreements across all codes:
- Content
40: 43 total disagreements across 33 codes |
Instagram
Post
- Content 26: 34 total disagreements across 24 codes | Instagram Post
- Content 33: 34 total disagreements across 28 codes | TikTok Video
- Content 1: 33 total disagreements across 24 codes | Facebook Post
- Content 39: 33 total disagreements across 25 codes | Facebook Post
- Content 11: 31 total disagreements across 17 codes | Facebook Post
- Content 30: 30 total disagreements across 27 codes | TikTok Video
- Content 10: 29 total disagreements across 25 codes | Facebook Post
- Content 35: 29 total disagreements across 22 codes | TikTok Video
- Content 8: 28 total disagreements across 20 codes | Facebook Post
Content Review
Content Review
Content 1
Coders: Daisy, Doortje, Ella, Lynn
Key Variables:
- AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
- Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
- Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
Content 2
Coders: Daisy, Doortje, Ella, Lynn
Key Variables:
- AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
- Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
- Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
Content 3
Coders: Daisy, Doortje, Ella, Lynn
Key Variables:
- AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
- Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
- Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
Content 4
Coders: Daisy, Doortje, Ella, Lynn
Key Variables:
- AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
- Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
- Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
Content 5
Coders: Daisy, Doortje, Ella, Lynn
Key Variables:
- AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
- Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
- Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
Content 6
Coders: Daisy, Doortje, Ella, Lynn
Key Variables:
- AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
- Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
- Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
Content 7
Coders: Daisy, Doortje, Ella, Lynn
Key Variables:
- AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
- Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
- Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
Content 8
Coders: Daisy, Doortje, Ella, Lynn
Key Variables:
- AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
- Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
- Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
Content 9
Coders: Doortje, Ella, Lynn
Key Variables:
- AI Image/Video (AI or not): Do:✓ El:✓ Ly:✓
- Negative Tendency/Tonality: Do:✓ El:✓ Ly:✓
- Positive Tendency/Tonality: Do:✓ El:✓ Ly:✓
Content 10
Coders: Daisy, Doortje, Ella, Lynn
Key Variables:
- AI Image/Video (AI or not): Da:✓ Do:✓ El:✓ Ly:✓
- Negative Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
- Positive Tendency/Tonality: Da:✓ Do:✓ El:✓ Ly:✓
Data Tables
Complete Reliability Statistics
Most Problematic Codes
Content Index
Code Search Tool
Use this table to search for any code and see all content that was coded with that code.
Search by Code
Coding Coverage by Coder:
- Doortje: 40 unique URLs coded
- Lynn: 40 unique URLs coded
- Ella: 39 unique URLs coded
- Daisy: 38 unique URLs coded
Type any code name in the search box below to find all content that was coded with that code.
Note: This table only shows content that was coded by at least 2 coders to ensure meaningful comparisons.
Dashboard generated on 2025-09-24 08:17:48.78421
Summary
Key Implementation Updates:
✅ Category Alignment Fixed: All binary conversion
logic now uses exact category text from categories.txt
✅ Conditional Coding Logic Implemented: - If coder determined image/video is “NOT AI-generated”, then ALL subsequent variables (AI Labeling, Number of People, Tonality, etc.) are correctly treated as NA (not coded) - This ensures reliability calculations only include coders who had the opportunity to code each variable
✅ AI Binary Variables Working: - “Partly AI-generated” correctly counts as 1 in “AI or not” binary variable - All AI categories (Completely, Partly, Not AI, Unsure) properly converted to binary format
Impact: - 23 responses were coded as “NOT AI-generated” - These coders are now correctly excluded from reliability calculations for subsequent variables - More accurate Krippendorff’s Alpha calculations for AI-related and content variables